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Abstract 

Establishing the capacity region of a Gaussian interference network is an open problem in information 
theory. Recent progress on this problem has led to the characterization of the capacity region of a general 
two-user Gaussian interference channel within one bit. In this paper, we develop new, improved outer 
bounds on the capacity region. Using these bounds, we show that treating interference as noise achieves 
the sum capacity of the two-user Gaussian interference charmel in a low interference regime, where the 
interference parameters are below certain thresholds. We then generalize our techniques and results to 
Gaussian interference networks with more than two users. In particular, we demonstrate that the total 
interference threshold, below which treating interference as noise achieves the sum capacity, increases 
with the number of users. 
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I. Introduction 

In his celebrated paper [3], Shannon established the capacity of the additive white Gaussian noise 
(AWGN) channel, where the performance is limited by thermal noise. In multiuser wireless networks, 
the performance is also limited by the interference from other users sharing the same spectrum. Unlike 
thermal noise, interference has a definite structure since it is generated by other users. Can this structure be 
exploited to decrease the uncertainty and thus improve the performance of the communication network? 
If so, what are the optimal signaling strategies? In this paper, we establish the somewhat counter- 
intuitive result that exploiting the structure of the interference in Gaussian interference channels does 
not improve the overall system throughput in a low interference regime. In other words, it is possible to 
treat interference as noise and still achieve the maximum possible throughput, if the interference levels 
are below certain thresholds. 




Z2 

Fig. 1. Two-user symmetric Gaussian interference channel 

Interference management is of vital importance in wireless communication systems, with several users 
contending for the same limited spectrum. As a first step towards an information-theoretic study of 
interference management, consider two users sharing a wireless channel as shown in Figure [T| where 
each user's receiver is interested in only the information transmitted by the corresponding transmitter. 
Each user's rate of communication is limited by the Gaussian noise at the receiver and the interference 
caused by the other user. Carleial [4] showed that interference does not reduce the capacity of such 
a two-user Gaussian interference channel in the very strong interference setting, where each receiver 
can completely cancel the interference by exploiting its structure. Subsequently, the capacity region was 
determined in the strong interference setting [5], [6], where it was shown that each user can decode the 
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information transmitted to the other user. Establishing the capacity region in the other regimes remains 
an open problem. The best known achievable region for the two-user Gaussian interference channel 
is based on the Han-Kobayashi (HK) scheme [5], [7]. Here the users split message into private and 
common messages, and each user jointly decodes its own messages and the common message of the 
interfering user. This is in general a sophisticated scheme, requiring multi-user encoders and decoders 
and coordination between the users. What we establish in this paper is that if the interference levels are 
low enough, then the receivers can treat interference as noise, and single users encoders and decoders 
can be employed without any loss in sum capacity. 

In order to establish the sum capacity in the low interference regime, we need to prove a converse, 
i.e., derive an outer bound on the sum capacity that matches with the sum rate achieved by treating 
interference as noise. The concept of a genie giving side information to the receivers was used in [8], 
[9] to derive outer bounds on the capacity region. Since the receivers can choose not to use the side 
information, the capacity region of the geiue-aided chaimel is an obvious outer bound to the capacity 
region of the interference chaimel. In [9], a specific set of geiue-aided outer bounds are shown to be 
within one bit of the capacity region. We show that the bounding technique developed in [9] is applicable 
to a wider class of genie signals. We further show that if the channel parameters satisfy a condition for 
low interference, the genie can be selected in a clever way so that the resulting genie-aided outer bound 
matches the sum rate achievable by treating interference as noise. With this wider class of genie signals 
and using the entropy power inequality [10], we also derive outer bounds on the entire capacity region 
that are tighter than existing outer bounds. Similar results have also been estabhshed independently by 
Shang et. al in [II] and Motahari et. al. in [12]. 

We then generalize the results to Gaussian interference networks with more than two users. Using a 
genie similar to that used for the two-user channel, we derive low interference regime conditions for 
the many-to-one interference chaimel, where the interference is experienced by only one user and one- 
to-many interference channel, where the interference is generated by only one user. We also propose a 
new genie construction, where each receiver is provided with multiple genie signals, for any arbitrary 
Gaussian interference network. This genie is a generalization of the genie used in [9] and the purpose 
of this generalization is to develop results analogous to [9] for arbitrary Gaussian interference networks. 
We show that treating interference as noise with Gaussian inputs achieves the sum capacity of the vector 
genie-aided channel. As done for the two-user chaimel, this outer bound can be tightened to establish the 
sum capacity in a low interference regime. We tighten the boimd for a three-user symmetric Gaussian 
interference chaimel, and demonstrate the existence of channels for which treating interference as noise 
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is optimal, but the total interference to noise ratio (INR) is greater than the INR threshold of the two-user 
interference channel. 

A. Notation and Organization 

We use the following notation. For deterministic objects, we use lowercase letters for scalars and 
uppercase letters in blackboard bold font for matrices. For example, we use h to denote a deterministic 
scalar and H to denote a deterministic matrix. For random objects, we use uppercase letters for scalars, 
and underlined uppercase letters for vectors. Random objects with superscripts denote sequences of the 
random objects in time. For example, we use X to denote a random scalar, 2L to denote a random vector, 
and X" and X" to denote the sequences of length n of the random scalars and vectors, respectively. We 
use Cov {X) to denote the variance of a random variable X, and Cov (X|y) denote the minimum mean 
square error in estimating the random variable X from the random variable Y, with similar notation for 
random vectors. We use J\f{fi,a'^) to denote the Gaussian distribution with mean fi and variance cr^, and 
J\f{fi, S) to denote the Gaussian vector distribution with mean // and covariance matrix S. We use h(.) to 
denote the differential entropy of a continuous random variable or vector and /(.;.) to denote the mutual 
information. 

The rest of the paper is organized as follows. In section [Ilj we introduce the model for the Gaussian 



interference network that we study. In Section III we summarize mathematical results such as the entropy 
power inequality and prove some new results that are required in establishing our new outer bounds. In 
Section llVl we review the existing bounds on the capacity region of the two-user Gaussian interference 



channel. In Section |Vj we establish the sum capacity of two-user Gaussian interference channel in a low 



interference regime. In Section VI we present new outer bounds on the capacity region of the two-user 



channel. In Section VII we present extensions of our results on the sum capacity in the low interference 



regime to Gaussian interference networks with more than two users. In Section VIII we provide some 
concluding remarks. 

II. Interference Network Model 

Consider a Gaussian interference network with M users, i.e., M pairs of transmitters and receivers, 
where no user is interested in the information transmitted to the other users. Over one symbol period, 
the channel is described by 

M 

Yr = Y,hrtXt + Zr,l<r<M (1) 



t=l 
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where Xt is the signal transmitted by transmitter t, hj-t is the fixed channel gain from transmitter t to 
receiver r, and the receiver noise terms {Zr}'^Li assumed to be zero mean, unit variance, indepen- 
dent Gaussian random variables. Furthermore, the noise is assumed to be independent and identically 
distributed (i.i.d.) in time. Transmitter t has an average power constraint Pt. In vector notation, ([T]) is 
equivalent to 

Y = mX + Z (2) 

where H is a deterministic M x M-matrix with elements {/ir,t}- 
The interference network is said to be in standard form [13], if 

/irf = 1) Vr = t. 

Any interference network ([2]) can be expressed in an equivalent standard form for the purposes of an 
information-theoretic analysis. For each user i, let the message index be uniformly distributed over 
{1,2,..., 2"-^-}, and let Ci{n) be a code consisting of an encoding function : {1, 2, . . . , 2"^'} iR" 
satisfying the power constraint 

\\X^{mi)\\^ <nPi,ym^ G {1, 2, . . . , 2"^'} 

and a decoding function gi : iR" — > {1,2, .. . ,2"^*}. The corresponding probability of decoding error 
Ai(n) is defined as P{m,j 7^ gi{Yf-)}. A rate tuple R2, . . . , Rm) is said to be achievable if there exists 
a sequence of codes {Ci(n), C2(n), . . . ,CA/(n)}^]^ such that the error probabilities Ai(n), A2(n), . . • , 
and Xuin) all go to zero as n goes to infinity. Capacity region is the closure of all the achievable rate 
tuples. 

III. Mathematical Preliminaries 

In this section, we review the information inequalities that are useful in establishing our new outer 
bounds. The first result is a generalization of the maximum entropy theorem. Consider a sequence of 



^1 



< nP. It is well known that 



random variables {X^ }"^^ with average power constraint X]j=i ^ 
h(X") < f log(27reP), and equality is achieved if and only if (iff) {Xi}"=i are i.i.d. Af{0,P) [10, 
Theorem 8.6.5]. The following lemma is a generalization of this result. 

Lemma 1: Let X be a random vector, and let y and S_ be noisy observations of X. 

Y =AX+Z 
S = MX + W 
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where Z_ and W. are correlated, zero-mean, Gaussian random vectors, and A and B are real valued 
matrices. Consider the random vector sequence X" = with the covariance constraint 

\iTTj=\^x3 ^ Sj;, where T^xj is the covariance matrix of X_y Furthermore, let and 5" be the 
corresponding observations when the noise vector sequences 7^ and each have components that are 
i.i.d. in time. Then, we have 

h(y"|5-) < n\^{XASG) 

where Y^q and S^q are y and when X = X^q ~ AA(0, S^). 

Proof: Let Q be a time sharing random variable taking values from 1 to n with equal probability. 
Let X^Q ~ A^(0, ^ Y^=\ ^a;i)' ^'I'i ^'I'i t>e the corresponding y and 5. 

n 

h(y"|s")= ^h(y^|r-\5") 

i=l 

= nh(y(j|SQ,Q) 

(6) 

where the steps (a), (b) follow from the fact that conditioning reduces entropy and step (c) follows 
because Gaussian distribution maximizes the conditional distribution for a given covariance constraint [14, 
Lemma 1]. 

Now letting X_q ~ A^(0,S-j; — ^ X^"=i ^xi)^ and further assuming that X^q is independent of X^q, 
Z and W^, we have 

Kiclitc) = h(A 1g + Z|B Xq + 

= h(A + 1g) + ^|B(1g + 1g) + 1g) 
< h(A (Xg + Xq) + Z|B (Xg + Xg) + IE) 
= K^gISg) 

where the step (d) follow from the fact that conditioning reduces entropy. ■ 
The following is the celebrated entropy power inequality (EPI) [10, Theorem 17.7.3] originally proposed 
by Shannon. 

Lemma 2 (EPI): For any independent random sequences X" and Z^, 
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Often, we are interested in the case where the sequence is i.i.d. Gaussian, in which case we have the 
following corollary. 

Corollary 1: Let X"' be a random sequence and be an independent random sequence with com- 
ponents that are i.i.d. AA(0, cr^). Then 

h(X" + Z'^) > ^ log (2th(^") + 27rea2) . 

Equivalently 

h(X-)<^log (2^^^(^"+^")-27rea2). 



As a corollary of the EPI, we have the worst case noise result that says that if the input distribution is 
i.i.d. Gaussian, then the noise that minimizes the mutual information under an average power constraint 
is also i.i.d. Gaussian. (See the mutual information game problem: 9.21 in [10].) With a little abuse of 
notation, the worst case noise results in the scalar and vector cases are as follows: 

Lemma 3 (Worst Case Noise: Scalar Case): Let X" be a random sequence with average power con- 
straint P, i.e., Yl]=i ^ -^j — ^^'^ t)^ independent random sequence with components 
that are i.i.d. Af{0,a^). Then 

h(X") - h(X" + Z") < nhiXc) - nh{XG + Z) 

where Xq ~ AA(0, P), and equality is achieved if X" = Xq, where Xq denotes the random sequence 
with components that are i.i.d. J\f{0,P). 

Proof: The result follows from the EPI (see proof of Lemma |5] below); a different proof is given in 
[15]. Interestingly, the result can be established as a direct consequence of the Lemma [1] as seen below 
in the proof of the Lemma |4] ■ 
Lemma 4 (Worst Case Noise: Vector Case): Let X^ be a random vector sequence with an average 
covariance constraint, i.e., X]j=i ^ nT^x, and let Z" be an independent random vector sequence, 
with components that are i.i.d. AA(0, S^). Then 

h(X") - h(X" + Z") < nh{Xa) - n\\{Xa + Z) 

where X_q ~ AA(0, S^;), and equality is achieved if X" = Xg, where Xg denotes the random sequence 
with components that are i.i.d. AA(0, Tj^)- 
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Proof: Although the proof follows from results given in [15], we provide a different simple proof 
based on Lemma [T] 

h(X") - h(X" + Z") = - /(Z"; X" + Z") 

= -h(Z") + h(Z"|X" + Z") 
= -nh(Z) + h(Z"|X" + Z:") 

(a) 

< - n\\{Z) + n\\{Z\Xa + Z) 

= nh^Xo) -nh{Xa + Z) 
where step (a) follows from Lemma [T] ■ 
Remark 1: As we have noted in Lemma |3j the scalar case of the worst case noise result is a corollary 
of the EPI. However, in the vector case. Lemma |4] does not follow from the EPI, unless T^x is a scaled 
version of S^. 

We now provide an extension of the scalar version of the worst case noise result, which is useful in 
deriving outer bounds on the sum capacity of interference networks with more than two users. This result 
might also be useful in other multiuser information theory problems. 

Lemma 5: For i = 1, 2, . . . , M, let Xf- be a random sequence with average power constraint Pi, i.e., 
Z]j=i ^ -^ij — ''^Pi- Further, let be a sequence with components that are i.i.d. AA(0, cr^). Assume 
that the sequences X^ are independent of each other and also independent of Z", and let Xic ~ AA(0, Pi). 
Then 

M I M \ M / M \ 

J2 Aih(Xr) - + Z" < n J] X^\^{XiG) - n/i + Z (3) 

1=1 \i=l J i=l \i=l / 

for all 

Pi 



EZi P^ + 

and equality is achieved in Q if for i = 1, . . . , M, X" = XV-^, where XV-^ denotes the random sequence 
with components that are i.i.d. AA(0,Pj). 
Proof: We will prove the lemma for 

V - 

' TZiP^ + -' 

The result with 

P 

Xi > 



EZi p^ + 

follows because the additional positive entropy quantities are easily seen to be maximized by X^q. 
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Denote ^ by ti and 27reo"^ by c. Using the EPI (Lemma 111, we have 



M / AI \ M / M 

A.h(Xr) - + Z" < n - log ^ 22*- 

1=1 \j=l / i=l \i=l 



+ C\ . 



Let f{t) = YaLi ^iti - 2 log yEiii 2^*' + cj. The concavity of / in t follows from the convexity of 

the log-sum-exp function [16]. Now, using 

df ^ 22*^ 
A,; 



it can be easily checked that {tj = \ log (27reP,)}^£i satisfy |^ = for all i. Thus, {tj = \ log (27rePj)}^£i 
maximizes the function /(t), and hence 

M / M \ 

A.h(xr) - + < nf{t) 

i=l \i=l J 

^1 I ( ^ 

< n J] Ai- log (27rePi) - n - log 27re ^ 

1=1 \ i=l 

M / M \ 

,J^Aih(XiG)-n/iK^X,G + ^ . 

i=l \i=l / 



Pi + 27re(7^ 



n 



We now prove the following straightforward lemma, which is nevertheless useful in handling the side 
information provided by the genie in our genie-aided outer bounds. 

Lemma 6: Let X" be a random vector sequence, and let and be (possibly correlated) zero- 
mean Gaussian random vector sequences, independent of X" and i.i.d. in time. Then 

where is i.i.d. (0, Gov 

Proof: Let z" be the MMSE estimate of Z" given W""- Then we have 

Z" = Z" + F". 

Now 

h(x" + y"|]E") 
h(x" + y") 

where the step (a) follows because the MMSE estimate z" is a function of WJ^, and the step (b) follows 
because the (observation) W '"" is independent of the MMSE error VJ^ and X". ■ 
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Lemma 7: For any random vectors X_, Y_ and S, 

1) ^{X; S\Y) = m X-Y- S form a Markov chain. 

2) X-Y-S form a Markov chain iff S{X, Y), the MMSE estimate of S given (X, Y), is equal to 
5(y), the MMSE estimate of S given Y. 

3) Furthermore if X, Y and 5 are Gaussian random variables such that 



where the zero mean Gaussian random variables Z and N are independent of X, then X — Y — S 
form a Markov chain iff E [NZ] = E [Z^] . 

Proof: 

1) Claim 1 follows from Theorem 2.8 in [17]. 

2) li ^ — form a Markov chain, then 



y = X + Z 



S = X + N 



S{X,Y)=E[S\X,Y] 




Ps\x,y{s\X = x,Y = y) = PeU - Six, y)) 



Ps\Y{s\Y = y). 



3) Observe that 



S{X, Y)=E [S\X, Y] = E [S\X, Z] 



= X + E[N\Z] 




From Claim 2, it follows ihatX-Y-S) form a Markov chain iff E [NZ] = E [Z^] . 
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Lemma 8: For any Gaussian random variables X, Y, Si and 5*2, I{X; S_\Y) = iff I{X; Si\Y) = 
and I{X;S2\Y) = 0. 

Proof: Since I{X;Si\Y) < I{X;S\Y) for i = 1,2, the 'only if part of the Lemma is clear. It 
remains to prove the 'if part of the Lemma and using Lemma |7j it is enough to show that X — Y — 
form a Markov chain if X — y — 5*1 and X — Y — S2 form Markov chains. 

Let X{Y) be the MMSE estimate of X given Y and E be the error in estimate. For i = 1,2, 
since X — Y — Si form a Markov chain, it follows from Lemma [v] that X{Y, Si) = X{Y). Hence E 
is independent of both Si and 5*2. Since E,Si and 5*2 are all Gaussian, E is also independent of 5. 
Therefore X{Y, S) = X{Y) and hence X - Y - S form a Markov chain. ■ 

IV. Two User Interference Channel: Existing Bounds 

The information-theoretic study of interference channels has mainly been limited to the two-user case, 
with the hope that the insights obtained from studying the two-user case can be generalized to an 
interference network with more than two users. With M = 2 in (|2]), we get the two-user Gaussian 
interference channel parameterized by {Pi, P2, /112, /121}: 

Yi = Xi + hi2X2 + Zi 

(4) 

Y2 = h2iXi + X2 + Z2 

with average transmit power constraints Pi and P2 on users 1 and 2, respectively. The capacity region 
of this channel is known only in the very strong interference [4] and strong interference [5], [6] settings, 
where it can be established that both the users can decode all the transmitted messages, and thus the 
capacity region is the same as that of the compound multiple access channel. In the rest of this section, we 
summarize the existing bounds on the capacity region of the weak interference channel, where hi2 < 1 
and /121 < 1. 

A. Inner bounds 

Simple schemes: In the interference free scenario, where hi2 = /i2i = 0, single-user Gaussian code- 
books at the transmitters are obviously capacity-achieving. Thus, if the interference is low, a reasonable 
strategy is to treat interference as noise at the receivers, and employ single-user Gaussian codebooks at 
the transmitters to achieve the following sum rate. 

Proposition 1 (Treating interference as noise): The sum capacity (Csum) of the two-user Gaussian in- 
terference channel Q is lower bounded by 
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Clearly such a strategy will not work if the interference is moderate, in which case, another simple 
alternative is to orthogonalize the users in time or frequency. 

Sophisticated schemes: Interference, unlike noise, is generated by other users and hence has a definite 
structure. Sophisticated schemes that exploit the interference structure could potentially perform better 
than the simple schemes described above. Han and Kobayashi introduced such a sophisticated scheme 
in [5], which results in the best known achievable region for the two-user channel. And while Chong, 
Motani and Garg have recently simplified the Han-Kobayashi region [7], it still remains formidable to 
compute. 

B. Outer Bounds 

The best known outer bounds to the capacity region of the two-user Gaussian interference channel are 
the one due to Sato, Costa and Kramer [18], [19], [8], which we refer to as the broadcast channel 
outer bound; and the one due to Etkin, Tse, and Wang [9], which we refer to as the ETW outer 
bound. In the rest of this section, we review these outer bounds. We also give a simple and more 
direct proof of the broadcast channel outer bound, and illustrate that it is a tightened version of the 
Z-channel sum rate outer bound [8], [20]. We make use of this connection to tighten the ETW outer 
bound in Section |Vll 

A salient feature of these outer bounds is that they are based on a genie providing side information 
to the receivers. Since the receivers can choose not to use the side-information, the capacity region of 
the genie-aided channel is an obvious outer bound on the capacity region of the interference channel. 
Throughout this paper, we will assume that the side information is linear in the inputs with additive 
Gaussian noise that is i.i.d. in time. Thus, the side information will be Gaussian if all the inputs are 
Gaussian. 

Some notation is required before proceeding further. The variable Sr denotes the side information 
given to receiver r, r = 1,2. The variable Xtc denotes the zero-mean Gaussian random variable with 
variance Pt, t = 1,2. The variables Y^g and Src denote the Gaussian outputs and side information at 
receiver r, respectively, that result when all the channel inputs are Gaussian, i.e., when Xt = Xtc, for 
t = 1, 2. The quantities X'^q, Y^q and S'^q denote i.i.d. sequences of the corresponding Gaussian random 
variables. 
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C. Bounding Techniques 

Consider the following possible ways of bounding the rate (Ri) of user 1 

• No Side Information: If the receivers do not receive any side information, then Ri can be bounded 
using Fano's equality as follows: 

n{Ri-en) < /(Xf;!?) 

= h(yi") - h(yi"|xn (5) 

<nh{YiG)-Hhi2X^ + Z^). 

• Interference Free: Providing receiver 1 with the knowledge of the interfering signal X2 can only 
increase the achievable rate Ri, hence 

n(i?i-e„) < /(Xi";yi",X2") 

= h{Y^\Xl^) - h(yi"|Xi", X^) (6) 
h(Xi" + ZD - nh[YiG\XiG,X2G) 

h{h2lX^ + /l21^r) - nh(/l2iyiG|^lG, X2g) 

where the step (b) follows because Yi\Xi,X2 is the Gaussian noise at the receiver, which is not a 
function of the input distributions. The scaling in the step (c) is done for convenience. 

• Genie-aided: Here a genie provides side information Si to receiver 1. As we stated earlier, we 
assume that the side information is linear in the inputs with additive Gaussian noise that is i.i.d. in 
time. For the two-user case, we further restrict our attention to genie signals such that, conditioned on 
the input sequence X^, the sequence S'^ is i.i.d. Gaussian (this holds, for example, if = X^+W^, 
where is i.i.d. Gaussian). Then we can write 

n{Ri-en) < I{X^;Y,^,S^) 

= /(Xf ; S"^) + /(Xf ; Y-^^IS"^) 

= h{S{') - h(5['|Xi") + h(yi"|5i") - h{Y{'\S^,X^) (7) 
h(5r) - nh{SiG\XiG) + h(yi"|5r) - h{Yr\S^,X^) 

< h(5i") - nh{SiG\XiG) + nh{YiG\SiG) - KYnS'^,X^) 
where the step (d) holds because of the assumption on the genie signal, and the step (e) follows 
from Lemma [T] 



(8) 



(9) 
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The term ni?2 can bounded in similar ways: 

• No Side Information: 

n{R2-en) = I{X^;Y^^) 

< nh{Y2G)-Kh2iXi + Z^). 

• Interference Free: 

n{R2-€n) < I{X^;Y2^\X^) 

< h{hi2X^ + hi2Z^) - nh{hi2Y2G\XiG,X2G). 

• Genie-aided: 

n{R2-en)< I{X^;Y2\S^) 

< h{S^) - nh{S2G\X2G) + nh{Y2G\S2G) - h{Y^''\S^,X^). 

D. Etkin, Tse and Wang (ETW) Outer Bound [9] 
If the genie signals are defined as 

51 = h2iXi + Z2 

(11) 

52 = ^12^2 + Zi 



(10) 



then the following relations hold true 

h{Y,^\S^,X^) = h{S^) 

(12) 

h(yi"|5r,Xi") = h{s^). 

Since hi2 < l,/i2i < 1, we can use the worst case noise result (Lemma |3]) to obtain the following 
inequalities: 

h(/i2i^r + ^21^1") - h(/i2i^r + Z^) < nh{h2iXiG + h2iZi) - nh{h2iXiG + ^2) 

(13) 

h{hl2X^ + huZ^) - h{hi2X^ + < nh{hi2X2G + /il2^2) - nh{hi2X2G + Zi). 

The relations ([12]) and (13^ , together with bounding techniques described in the previous subsection, 
lead succinctly to the outer bound on the capacity region given by Etkin, Tse and Wang [9]: 
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Lemma 9 (Etkin, Tse and Wang [9]): The capacity region of a two-user Gaussian interference channel 
with hi2 < 1 and /121 < 1 is contained in the region: 

(14) 
(15) 
(16) 
(17) 
(18) 
(19) 
(20) 

where the genie signals {81,82} are defined in ( [IT] ). 

Proof: The outer bounds immediately follow by choosing the appropriate bounding technique from 
Section |IV-C[ and using the relations ( [T3] ) and ([12]), where necessary. For example, to derive the bound 
([17]), use ([5) and ([9]) and use the worst case noise result ([13) to show that h(/ii2X2 +/ii2-^2 ) ~ h(/ii2X2 + 
Zf) is maximized by Xgg- To derive the bound (^81, use ([7]) and ( [T0| and use {12) to show that the 



Ri < 




I{Xig;Yig\X2g) 




R2 < 




I{X2G', Y2g\Xig) 




Ri + R2< 




i{Xig; yiG\X2G) + i{X2g; Y2g) 




Ri + R2< 




I{Xig;Yig) + I{X2g;Y2g\Xig) 




Ri + R2< 




I{Xig; YiG, 8ig) + I{X2g', Y2G, S2G) 




2Ri + R2< 




Yig\X2g) + I{Xw; Yig) + I{X2g; Y2g 


'S'2g) 


Rl + 2i?2 < 


I{XiG 


YiG, Sig) + /(^2g; >2g|^ig) + /(^2G 


Y2g) 



right hand side (RHS) of ([7) plus the RHS of ([TO]) is maximized by X^^ and X^^ 



Remark 2: The RHS terms in the outer bounds can easily be shown to be equivalent to those in 
Theorem 3 of [9] by making the following substitutions: 

I{Xig;Yig\X2g) = ^log(l + Pi) 
/(Xig;1ig) = Jlogfl + 



2 l + /i?2^2 

/(XiG;yiG,5,c)=^log(l + /.^,Pi + ^^^ 

and similar substitutions for the terms corresponding to user 2. 

The form of the outer bound given in Lemma [9] is strikingly similar to the simplified HK region [7], 
and in fact a special case of the HK region is shown to be within one bit of the outer bound [9],[21]. 

E. Outer Bounds to One-Sided Interference Channels 



In deriving the bounds (16 1 and (17i, one of the receivers is made interference free. Thus these 



outer bounds are derived for the one-sided interference channel, where only one user experiences the 



interference. Such a channel is also called the Z-channel, and we therefore refer to the outer bounds ( 16 1 



and ( 17 1 as the Z-channel sum rate outer bounds. 
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In [19], Costa showed the equivalence between the Z-channel and the degraded interference channel, 
and in [18], Sato showed that the capacity region of the degraded interference channel is contained in 
the capacity region of a broadcast channel. Using these ideas, Kramer established an outer bound to the 
capacity region of the Z-channel [8]. We refer to this outer bound as the broadcast channel outer bound. 
We show that broadcast channel outer bound is a tightened version of Z-channel sum rate outer bound, 
and thus provide a simple and direct proof of the broadcast channel outer bound. In deriving the Z-channel 
sum rate outer bound ( [TT] ), we have used the worst case noise result to relate the terms h(/ii2A^2 +^12-^2 ) 
and h(/ii2X2 + Z^. Instead, the EPI can be used to obtain a tighter relation, which results in the 
broadcast channel outer bound. 

Lemma 10 (Broadcast channel outer bound [18], [19], [8[): The capacity region of a two-user Gaus- 
sian interference channel with hi2 < 1 and /i2i < 1 is contained in the region 

1, f l + Pl+hl^P2 



By changing the order of the users, we also have 



Proof: Using (|5]) and (|9]), we have 



nRi < I log(2^e(l + Pi + /if^Pa)) - hihi2X^ + Z^ 
nR2 < h{huX^ + hi2ZD - ^log(27re/i?2)- 



From the EPI (Corollary [T]), it follows that 



h{hi2X'^ + ZD > ^ log (2TTe{l - hl2) + 2^h(?M2X?+hi.z,") 



> - log (27re(l - hl2) + 27re/i?22'^^] 



Therefore, 

n 
2 

,2 



nRi < - log(27re(l + Pi + /i?2^2)) - 77 log (27re(l - /i?2) + 27re/i?22'^^) 



n f l + P^ + hi^P2 
2'°Hl-/^?2 + ^?222^^ 



Remark 3: The outer bound in Lemma 10 can be shown to be identical to that presented in Theorem 2 
of [8]. 
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F. Tightening the Outer Bounds 

The outer bounds presented above can be tightened by using the following observations: 



Generalized Genie: In [9], the genie ( 11 1 is selected to satisfy ([T2|). However the techniques developed 



in [9] can be generalized to a larger class of genie signals, by using the worst case noise result to 



relate the terms in ( 12) instead of canceling the terms. In fact one of the main results of this paper, 
the sum capacity of the two-user Gaussian interference channel in the low interference regime, is a 
direct consequence of this observation. 

EPI-based bounds: We have shown that the broadcast channel outer bound is a tightened version of 



sum rate bounds of ( [16] ) and ( [17] ) by using the EPI instead of the worst case noise result. We can 
similarly apply the EPI to the other outer bounds in the Lemma [9] 
We now proceed to use these observations to tighten the existing outer bounds. 

V. Two User Interference Channel: Sum Capacity in Low Interference Regime 

Consider the limiting scenario where the interference parameters {hrt}r=/=t go to zero uniformly. In 
the limit, when there is no interference, single user Gaussian codes are optimal. Given this fact, a 
natural question to ask is the following: In terms of the optimality of single user Gaussian codes, is 
the transition from "no interference" to "interference" continuous? If any other strategy performs better 
than treating interference as noise, then this implies that the receivers are able to exploit the structure in 
the interference. On the other hand, for low enough interference levels the receivers may not be able to 
exploit such structure. Thus it is reasonable to expect the transition to be continuous. In this section, we 
establish this notion mathematically by showing that treating interference as noise indeed achieves the 
sum capacity in a low (but nonzero) interference regime. 



A. Symmetric Interference Channel 

The essential ideas and results on the sum capacity of the two-user interference channel are captured 
in the symmetric interference channel, for which Pi = P2 = P and /112 = /121 = h. For this channel we 
shall establish the following result. 

Theorem 1: For the symmetric interference channel, if the interference parameter h satisfies the con- 
dition 

\h + h^P\<0.5 (23) 
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then treating interference as noise achieves the sum capacity, which is given by 



Csum = log ( 1 + 1 . (24) 



Since the achievabiUty part of the theorem is obvious, we only need to establish an upper bound on 
Csum that matches the expression given on the RHS of We use the concept of the genie-aided outer 



bound (see Section IV-Cl, but with a class of genie signals that is more general than that used for the 



ETW bound of Section IV-D In particular, we wish to choose the genie to produce the tightest possible 



upper bound. To this end, we introduce the following two qualities of a good genie. 



Useful Genie: The ETW genie (111 is useful in deriving an outer bound on the sum capacity of 



the interference channel. The reason behind its usefulness is the property (12i that facilitates the 



derivation of the sum capacity of the genie-aided channel. Using ( 12), it can be shown that Gaussian 
inputs, which are i.i.d. in time and satisfy the power constraint with equality, are capacity achieving 
for the genie-aided channel. Hence the sum capacity of the genie-aided channel equals 

/(Xig; YiG, Sig) + I{X2g; >2G, S2g)- (25) 

Interestingly, there exists a larger class of genie signals for which the optimality of Gaussian inputs 
holds. We therefore define a genie to be useful, if it results in a genie-aided channel whose sum 
capacity (is achieved by Gaussian inputs and) is given by ( [25] ). 

A second example of a useful genie signal is the interference removal genie, i.e., the genie that 
provides side information Si = X2 to receiver 1 and side information S2 = Xi to receiver 2. Such 
a genie is clearly useful because the resulting genie-aided channel is the parallel Gaussian channel 



whose sum capacity is easily seen to be given by (25). However, being too generous, such a genie 
does not result in a tight upper bound. This leads us to the notion of a smart genie. 
• Smart Genie: A smart genie results in a tight upper bound on the sum capacity. More precisely, if 
Gaussian inputs are used, then the presence of the genie does not improve the sum rate, i.e., 

I{XiG',yiG, Sig) = I{Xig',Yig) 

I{X2G',Y2G, S2g) = -^(-^^20; ^2g)- 

An example of the smart genie is one that does not interact with the receivers at all; however, it is 
obviously not useful. 

If the genie is useful and smart, then the sum capacity is upper bounded by I{Xig', YiGi Sig) + 
I{X2G', y2G, S2g) = li^iG'-i Yig) + I{X2g'-, ^2g)» which is the sum rate achieved by treating interference 
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as noise. Thus it is enough to show the existence of a genie that is both useful and smart to prove 
Theorem [T] So the essential question is: Is there a "divine" genie that is both useful and smart? 

The quest for the divine genie can be simplified by imposing a structure on the side information it 



provides. Following ( |TT| ), we set: 

Si = hXi + hr]Wi 



(26) 

52 = hX2 + hrjW2 



where Wi, W2 ~ AA(0, 1) and 77 is a positive real number. However, unlike in ( ]_l_i, we allow Wi to be 
correlated to Zi (and W2 with Z2), with correlation coefficient p. 

Lemma 11 (Useful Genie): The sum capacity of the genie-aided channel with side information given 



in ( |26| ) is achieved by using Gaussian inputs and by treating interference as noise at the receiver if the 
following condition holds: 

M < Vl-p^. (27) 
Hence the sum capacity of the symmetric interference channel is bounded as 

Csum < I{Xig; YiG, Sig) + I{X2g; Y2G, 820). (28) 



Proof: Add ([t]) and (10) to get the following outer bound on n(i?i + R2 — 2e) 

h(5n - nh{SiG\XiG)+nh{YiG\SiG) - HYr\S^,X'^) 

+ h{S^) - nh{S2G\X2G) + nh{Y2G\S2G) - h(y2"|52 ,^2 )• 
Thus it only remains to show that 

h(5n - h{Y2^\S^,X^) + h{S^) - h{Yr\S^,X^) 

is maximized by X^^^ and ^2G- Now consider 

h(5n - h{Y^\S^,X^) = h{hX^ + hr)W^) - h(/iXi" + Zl^\W^) 



(a) 



(b) 



< nh{hXiG + hrjWi) - nh{hXiG + V) 
where V ~ A^(0, 1 — p'^), independent of Xi. Step (a) follows from Lemma [6] and step (b) follows form 
condition ( 27 1 and the worst case noise Lemma |3] Thus h{Sf) - h{Y{'\S^,X^) is maximized by Xj^^, 
and similarly h{S^) - h(yi"|S'f , ) is maximized by X^^. ■ 
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(29) 



Lemma 12 (Smart Genie): If Gaussian inputs are used, the interference is treated as noise, and the 
following condition holds 

r]p = l + h^P 

then the genie does not increase the achievable sum rate, i.e., 

/(Xig;1ig,5ig) = I[Xig;Yig) 

The converse is also true, i.e., ([30]) implies p9] l 
Proof: Since 

I{XiG; YiG, Sic) = I{XiG; YiG) + I{X,g; Sig^g) 



(30) 



([30]) is equivalent to 

I{XiG;S,G\YiG) = 
^ I{XiG; XiG + nW.i\XiG + hXjG + ^i) = 

^ E [nWi{hX,G + Zi)\ E [{hX,G + Zif] 

rip=l + h^P. 

where the step (a) follows from Lemma |7] and the index j = 2 if i = 1 and vice versa. ■ 

In Figure [2] we plot the usefulness and smartness constraints (27i and (29 1 in the Hilbert space L?' of 
random variables. Figure ]2] only shows the plane containing the transmitted signal Xig, the received 
signal YiG = Xig + hX2G + Zi and the genie signal = Xig + with origin shifted to Xig- We 
can view the usefulness and smartness constraints (27i and (29) on the genie as regions in the space: 
• Useful Genie: The genie is useful, if it lies inside the dashed curve in Fig. |2] The boundary of the 



curve is obtained using the usefulness condition ([27 1. 
• Smart Genie: The genie is smart, if it lies on the solid line in Fig. [2| This is expected because 

XiG — {XiG + hX2G + Zi) — {XiG + 'r]Wi) form a Markov chain iff Xig + rjWi is a degraded 

version of Xig + hX2G + Zi. 
There exists a genie that is both useful and smart if the usefulness region intersects with the smartness 
line in Fig. [2] i.e., if there exist rj and p satisfying the conditions of both Lemma 11 and Lemma 12 



Eliminating 77 from (27 1 and (29 1 we get 



\h + h^P\ < |p|^l-p2 
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Fig. 2. The figure is a Hilbeit space representation of the channel input, channel output and genie signal. The genie is a) useful 
if it lies inside the dashed curve, and b) smart if it lies on the solid line. If the dashed curve and solid fine intersect, treating 
interference as noise achieves sum capacity. 



which is possible iff 

\h + h^P\ < 0.5. 

This completes the proof of Theorem [T] ■ 
Remark 4: Lemma [TT] is valid even if the interference channel is not in the low interference regime. 



Therefore, minimizing the expression ( 28 1 over all possible genie signals satisfying the usefulness con- 



straint ( 27 1 results in a valid outer bound. The notion of the smart genie, therefore, can be thought of as 



an intuitive way of identifying the genie that minimizes ([28]). In [1], we use the geometric interpretation 
of the Figure [2] to identify the useful genie that minimizes ( 28 1 when the channel is not in the low 
interference regime. 

In Figure |3j we plot the new outer bound along with the Z-channel sum rate outer bound ( [TT] ) and the 
ETW outer bound ( fTS] ). Observe that the new outer bound matches with the inner bound obtained by 
treating interference as noise when the interference is below a treshold. Figure |4] shows the interference 
to noise ratio (INR) threshold, below which treating interference as noise achieves the sum capacity, as 
a function of the signal to noise ratio (SNR) in dB scale. It can be easily shown that the INR threshold, 
in a dB scale, is equal to one third of the SNR in the high SNR asymptotic regime. 
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Fig. 3. Sum capacity of the two-user symmetric Gaussian interference channel in the low interference regime. 
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_10i < < < < < < < 1 

5 10 15 20 25 30 35 40 

SNR 

Fig. 4. Two user symmetric Gaussian interference channel: INR threshold, below which treating interference as noise achieves 
the sum capacity, as a function of the SNR. 
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B. Asymmetric Interference Channel 

For the asymmetric interference channel, we consider the asymmetric genie: 

Si = h2i{Xi + r,iWi) 

(31) 

5*2 = hi2{X2 + ll2W2)- 

Let pi be the correlation between Zi and Wi (and p2 the correlation between Z2 and W2). 

Theorem 2: Consider the asymmetric interference channel with interference parameters hi2 and h2i 
satisfying 

|/ll2(l + hl^Pi)\ + |/I2l(l + /l?2^2)| < 1. (32) 

Then treating interference as noise achieves sum capacity, which is given by 

Csum = - log ( 1 + . . . „ I + - log ( 1 + 



2 l + /i?2^2y 2 l + hl^Pi 

Proof: The proof is similar to that for the symmetric interference channel. Using the same arguments 
as in Lemma [TT] the genie is useful if 



\h2im\ < ~/'2 



\hi2m\ < \/i - Pv 



Also, as in Lemma 12 the genie is smart iff 

rjipi = 1 + /ii2-P2 
mP2 = l + hl^Pi. 

Thus there exists a useful and smart genie if there exist pi G [0, 1] and p2 G [0, 1] such that 



\hi2{l + hl^Pl)\<P2^l-pl 

(33) 



\h2l{l + hi2P2)\<Pl^l-pl 



By setting pi = cos (pi and p2 = cos (j)2, ([33]) implies p2] ). It is also true that ( [32] ) implies p3] ). This can 
be seen by setting cf) such that 

|/ll2(l + hl^Pi)\ < COS^cj) < 1 - |/l2l(l + /i?2^2)|. 

i.e., 

1/112(1 + I <cos2(/) 

|/i2i(l + /i?2A)| <sin2</,. 

Setting pi = sin (/> and p2 = cos (?!), we have ( (33| ). ■ 
Remark 5: Theorem [2] is establised independently in [11] and [12]. 



24 



VI. Two-User Interference Channel: Outer Bounds to the Capacity Region 

In Section IV-F we observed that the ETW outer bound in the Lemma|9]can be tightened by considering 
a general class of genie signals and using the EPI instead of the worst case noise result. In this section, 
we use these observations to improve the outer bounds. 

Theorem 3 (EPI-Based ETW Outer Bound): The capacity region of a two-user Gaussian interference 



channel with hi2 < 1 and /121 < 1 is outer bounded by the regions given below in Lemmas 13 and 14 



along with the Lemma 10 



Lemma 13 (Tightened version of the outer bound on Ri + R2 (|18|)j." The capacity region of a two- 
user Gaussian interference channel with hi2 < 1 and /i2i < 1 is contained in the region 

1 /<- /V le ^^ 1 / Co.{S^a)Coy{Y,o\S,c) ^-2R, 2' 



2 ^ yCov {S2g\X2g) J 2 "I Cov(5iG) + cTi 

for all {'rii,'r]2, pi, P2}, the parameters of the genie defined in (31 1, such that 

al = l-pl-{h2im? > 

al = l-p\- {huV2f > 0. 
Interchanging the user indices, we get another such bound. 
Proof: Using (|7]) and ( [TO] ), we have 

nRi < h{S^^) - nh{SiG\XiG) + nh{YiG\SiG) - HY,^\S'^,X^ 

nR2 < HS^) - nh{S2G\X2G) + nh{Y2G\S2G) - HYi'\S^,Xl 



Denote 



to obtain 



nr2<h{S^)-h{Y^^\S^,X^). 
To apply EPI, {r/i, ?72, /Ci, /O2} should satisfy 

{h2imf < 1 - pi 



(34) 



(35) 



(36) 
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Define the slack variables 

0"l = 1 - P2 - (^21??l)^ 

o"2 = 1 - Pi - {hi2mf- 

Using EPI (Corollary [T]), we have 

nT2<KS2)-KY^\S^,Xl^) 

h{Yr\s^,x-) 

h{5i")2-2ri _ 



< n-log (2" 



27reaf ) -n-log(2 



+ 27re(72 



r2 < - log (^2^ 

< ^log {2'^iS,a)2'^r, 



1 



2 log (^2i^h(^")+27rea2^ 
-log f22h(^^-)+27reai 



27recj^ 



-2ri 



^ 1 /Cov(5,c)2 

- 2 ^ V Cov (5ig) + <J: 



By eliminating ri and r2, we get 



1 /Covil2C^\ 1 

'-2 ^VCov(S2g|X2g); 2 ^ 



' Cov (5i G )Cov (Yi G I Si G ) o - 2i;i 
Cov(Siel^iG) 

Cov + a2 



Remark 6: Lemma 13 being a tightened version of the ETW sum rate outer bound ( [18) , includes the 
new sum rate outer bounds presented in Section |V] 



Lemma 14 (Tightened versions of the outer bounds on 2Ri + R2 ( |19| ) and Ri + 2i?2 (|20|) ): The capac- 
ity region of a two-user Gaussian interference channel with hi2 < 1 and /121 < 1 is contained in the 
region 

„ , 1, (Cov(Y2o\S2a)\ ^l, /Cov(Fig)2-2«' -<T? 



for all {r?i, 772, /Oi, /92}, the parameters of the genie defined in (31 1, such that 



1 



> 



f^i = 1 - pi - ^21 > 0. 

Interchanging the user indices, we get another such bound. 
Proof: Use (|5), ^ and ([TO]) to obtain: 

nRi < nh(YiG) - ^^12X2 + 

niii < h(/l2lXi" + /i2lZi") - nh{h2lYiG\XiG,X2G) 

nR2 < h{S^) - nh{S2G\X2G) + nh{Y2G\S2G) - HY2''\S^,X^ 



(37) 



26 



To apply EPI, {rii,ri2, Pi, P2} should satisfy 

hum < 1 



Define the slack variables 



h21 < 



4 



1 - {hum? 

I- pI- /l21- 



Using EPI (Corollary [TJ and the bounds on nRi in (37 1, we obtain 



(a) 



KS2) < ^log(2"^(''^^^^+^") -27re(j? 
< I log (22h(no)2-2i?i_2vrea2) 



and 



h(Y^\S^,X^) > I log (2^Hh2^x^+h,,z^) ^ 27ref7, 

>^ ^ log (27re22^i/i2i + 27recr|) 
where the steps (a) and (c) follow from EPI (Corollary [T]) and the steps (b) and (d) use the bounds on 



nRi in (jSTjl. Using the above relations with the bound on ni?2 in (jSTj), we obtain 
i?2 < ^ log (Cov (Fig) 2-^^^ " " ^ log (Cov (52g|^2g)) 



J log (Cov {Y2g\S2g)) - J log (/iii22«^ + 



(38) 



1, ( Cov{Y2g\S2g)_ 
2 °^ VCov(52g|^2g) 



Vilogf ^"^(^^"^^""^---n 



A. Numerical Results 

In Figures [5] and |6j we plot the new outer bound, i.e., EPI-based ETW outer bound, along with the 
original ETW outer bound and the broadcast channel outer bound. To compare the outer bounds, we also 
plot a special case of the Han-Kobayashi inner bound, that does not include time sharing and is limited 
to only Gaussian distributions for the private and common messages. Since the EPI-based ETW outer 
bound contains the original ETW outer bound and broadcast channel outer bound as special cases, it is 
obviously tighter. Figure [s] corresponds to Pi = 10,^2 = 20, /if2 = 0.04, /121 = 0.09, which satisfy the 
condition ( |32| ) for low interference, and hence the inner and outer bounds meet at one point to give the 
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Fig. 5. Two user Gaussian interference channel (Pi = 10, P2 = 20, ~ 0.04, — 0.09) in low interference regime: 
Bounds on the capacity region. 
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sum capacity. Figure |6] corresponds to Pi = P2 = 7, /if 2 = ^21 = O-^' which do not satisfy the condition 



pip for low interference, and hence inner and outer bounds do not meet. 

As discussed in Section IV-F[ the outer bounds presented in this paper are tightened versions of the 



ETW outer bounds, obtained by considering a general class of genie signals and using EPI instead of 
the worst case noise result. Similar approach has been taken independently by two other groups - Shang, 
Kramer and Chen [11] and Motahari and Khandani [12]. The main difference in the approaches is that 
[11] and [12] use extremal inequality [22] instead of EPI. Although the extremal inequalities proposed 
in [22] are more general than EPI, both are equivalent for the purpose of this paper. Hence we believe 
that both the approaches should yield the same bounds. Shang et. al. tightened only the sum rate outer 
bound (18 1 and hence their outer bound, equivalent to Lemma 13 is weaker compared to Theorem [3] that 



includes Lemma 14 as well. Motahari et. al. tightened all the ETW outer bounds and hence their outer 
bound is equivalent to Theorem [3] We may compare Figure [6] with Figure 3 in [12] and Figure |5] with 
Figure 4 in [11]. 

VII. Gaussian Interference Network: Sum Capacity in Low Interference Regime 

In section |V| we established the sum capacity of the two-user Gaussian interference channel in a low 
interference regime. The intuition is that if the interference is low enough, the receiver will not able to 
exploit the structure in the interference, and hence treating interference as noise achieves the sum capacity. 
It is natural to verify if the result can be extended to an arbitrary interference network, and if it does, 
to see how the interference threshold scales with the number of users. In this section, we first consider 
two special cases of the general interference network: the many-to-one interference channel, where only 
one user experiences interference, and the one-to-many interference channel, where the interference is 
generated by only one user. For these two special cases, we use a genie similar to that used for the 
two-user interference channel, which we call now a scalar genie, to propose conditions under which 
treating interference as noise achieves the sum capacity. 

Using the scalar genie, Shang et. al. derived conditions for the optimality of treating interference 
as noise for an arbitrary Gaussian interference network [23]. For symmetric interference channels, this 
results in an INRtotai threshold, below which treating interference as noise achieves sum capacity, that 
is independent of the number of users. Here we use the notation INRtotai for a symmetric interference 
channel to denote the total interference-to-noise ratio. We show that there exists an alternative construction 
of the genie, where each receiver is provided with multiple genie signals, resulting in a INRtotai threshold 
for the symmetric three-user interference channel, that is higher than the INR threshold for the symmetric 
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two-user interference channel. 

A. Many-to-one and One-to-many interference channels 

The many-to-one and one-to-many interference channels are studied in [24], [25], where the capacity 
region is characterized to within a constant number of bits. 

Many-to-one: In a many-to-one Gaussian interference channel only one user experiences the interference, 
i.e., 

hrt = 0,Vt / r,Vr / 1 

where we assume that the user 1 is the unlucky user without any loss of generality. Thus the many-to-one 
Gaussian interference channel is parameterized by {Pi, P2, • • • , Pnu ^12, hn, • • • , /iia/}: 

M 

=Xi + y^h,tXt + Zi 

t=2 (39) 

Yr =Xr + Zr, for r = 2, 3, • • • ,M. 
One-to-many: In a one-to-many Gaussian interference channel only one user causes the interference, i.e., 

hrt = 0,Vr / t,Vt / 1 

where we assumed that user 1 is the interfering user. Thus the one-to-many Gaussian interference channel 
is parameterized by {Pi, P2, • • • , Pm, /i2i, /131, • • • , ^mi}: 

Yi =Xi + Zi 

(40) 

Yr =hriXi + Xr + Zr, for r = 2, 3, • • • , M. 



Theorem 4: For a many-to-one interference channel ( |39| ) satisfying 

M 

E^i^^l (41) 

1=2 

treating interference as noise achieves the sum capacity, which is given by 



1 / P \ 1 ^' 

2 log 1 + M L p. + 2 + • (42) 
Proof: Allowing the interfering users to cooperate can only increase the sum capacity. Let be 

the vector denoting the collective received signal, and denote the corresponding transmit and 
noise vectors and h = [/112 /113 • • • /iim]^ to arrive at 

Yi = Xi + h^Xj + Zi 

Yi = Xi + Zj 
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Let Sj = h^J^i + Wj be the side information given to the (collective) receivers of the interfering users. 
Here Wj is zero mean, unit variance, Gaussian random variable. Using Fano's inequality, we have 

M 
i=l 

= /(Xi"; Fi") + I{2C}; Sf) + I{2C};r}\Sf) 

= h(yi") - h{sf) + h{sf) - h(w^f ) + h(y?|57) - h{z'}\wj') 

= h{Yn - nh{WiG) + HY1\S?) - nh{Zja\WiG) 

< nh(yiG) - nh{WiG) + nh{Yja\SiG) - nh{Zja\WiG) 

= nI{X,G; Yig) + nI{Xja; Yja, Sjg) 
where the step (a) follows from Lemma [T] Thus the genie is useful. If ( 41 1 is true, then the random 
variable Wj can be chosen such that 

Wi = ifZj + V 

where the Gaussian random variable V is independent of Zj. Therefore, 

Si = ifYj + V 

and hence I{2Lig'^^ig^ ^ig) = I{^ig'^^ig) making the genie smart. Hence the theorem follows. ■ 



Theorem 5: For a one-to-many interference channel ( |40| ) satisfying 

yh^jPy + hl^^ (43) 



treating interference as noise achieves the sum capacity, which is given by 

M 



C.. = ^ log (1 + A) + ^ E log (l + ^^^) (44) 



i=2 

Proof: We prove this theorem directly without the aid of a genie. 

M 

n{C,,^ - Men) < /(^r; n") + E ^(^r; YD 

1=2 

M 

= h(yi") - KY^m + E KY^n - h(>i"i^r) 

i=2 

M 



= h(n") - nh{Y,G\X,G) + E KY^n - h(yr I^D 

1=2 

M 

< h{Yn - nh{YiG\X,G) + ^nh{YiG) - HY^Xl 



i=2 
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To finish tlie proof, we further need to show that 

M 



i=2 

M 



i=2 

M 
i=2 

lA/ „„„i, tUot V^Af 



is maximized by Xf = X^q, for some {Aj}fj^2 ^uch that X]i=2 ~ ^- holds, it is possible to 

chose {Ajjfig satisfying 

For this choice of A,, from Lemma|5j it follows that Ajh(/ijiX" + /ijiZ") — h(/ijiXf + and therefore 
Aih(Xf + Zf ) - h{hiiXf + Zf ), is maximized when = X]"^. Hence the result follows. ■ 

Remark 7: Theorems |4] and |5] can be shown to special cases of Theorem 4 in [23]. 
B. Vector genie 

We now propose a systematic construction of an useful genie for an arbitrary interference network. We 
call this a vector genie because it involves giving multiple side information signals to each receiver. This 
vector genie can be thought of as a generalization of the ETW genie ( [TT] ) developed for the two-user 
interference channel. We need to define an ordering function before constructing the vector genie signal. 



Definition 1 (Ordering function): We call a function vr : {1, 2, • • • , M} — > {1, 2, • • • , M} an ordering 
function if it satisfies the following properties 

{1,^(1), ,^(A/-l)(i)} = {i^2,-.. ,M} 

(45) 

7rW(r) = r,Vr 

where 7r(-'^(.) denotes the function 7r(.) operated j times. 

Definition 2: Suppose Yj. is a random variable that is an affine combination of the variables {Xt}fli. 
For any ^ C {1, 2, • • • , M}, Yr\{Xt, t e A} denotes the random variable obtained after removing the 
contributions of {Xt,t G A} from Yr. 
For any fixed ordering function vr, let 

Sj. = [Sr,l Sr,2 ■ ■ ■ Sr,M-l]^ 
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be the side information given to the receiver r, defined as 

Sr,k = y^(.)(r)\{X^u)(r)}i=i, for A; = 1, 2, • • • , M - 1. 
For example, consider the three user interference network. With the ordering function 

7r(l) = 2,7r(2) = 3, 7r(3) = 1 



(46) 



we see that the genie signals defined by (46 1 are: 





r = 1 


r = 2 


r = 3 


Yr : 


Xi + /112X2 + /iiaXg + Zi 


X2 + h2lXi + /l23-^3 + Z2 


X'i + /l3lXi + /l32^2 + ^3 


Sr,l '■ 


h2iXi + h2zX^ + Z2 


hz2X2 + h'iiXi + Z3 


/il3-'^3 + /il2-'^2 + Zi 


Sr,2 '■ 


hziXi + Z3 


/ll2^2 + ^1 


^23-^^3 + -^2 



The following properties of the genie ( |46l ) are useful in deriving the outer bounds. 

Proposition 2: For each r, the genie signal Sr^M-i is interference free, i.e., Sr^M~i\Xr is Gaussian. 



Proof: From the construction of the genie (46 1, we have 



which implies that 



Sr,M-l — ^7r(J*^-i)(r)\{^7rO)(r)}jll"'" 

Sr,M-l\Xr == y7r(M-i)(j.)\{X7rU)(r)}*£l 
— Y^(''i-i)(^r)\{Xj}jLl 

= Z^(M-\)[j.^ 



where steps (a) and (b) follow from the property ( [45] ) of the ordering function tt. 
Proposition 3: For each receiver r, define 

Y^r = [Y Sr,l Sr,2 ' ' ' »S',.^Af-2] 



(47) 



then 



Proof: The result follows because 
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and for fc = 2,3,--- ,M-1, 



Sr,k = ^7r('=){r)\{-'^7r<3)(r)}j=l 

= yjr(''-i)(7r(r))\{-'^7rO)(r)}j = l 

= y^(fc-i)(^(^))\ |{Xj,u)(j,)}j^2) -'^7r{r)| 

= y^(fc-i)(^(j.))\ |{-'^7rO)(7r(r))}^=l)-'^7r(r)| 

= 'S'7r(r),fe-l\^7r(r)- 



We now proceed to show that the vector genie ( [46| ) is useful and derive an outer bound on the sum 
capacity. 



Theorem 6: For any ordering function vr, the genie defined in ( |46| ) is useful, i.e., the sum capacity of 
the interference network ([2]) is upper bounded by 



M 



i=l 



where the genie signals are defined in (46 1. 
Proof: 



M 



(C,,^-Me„)< Y^I{X^;Yr,S2) 
1=1 

M 

= ^h(y,",5r)-h(y,",5r|x 

i=l 
M 

= ^h{Yr,s:)-h{r:,siM_,\xr 

i=l 

M 

= E ^ (^") + ^ (^"1^") - h (^"m-iI^d - h (yri^i:M-i, X 

i=l 

A/ Af 

= E h {Yr\s2) - h (5i:M-iixr) + ^ h (^d - h (£^1^0.-1, 

i=l i=l 
M M 

1=1 

M 

= Y.^{Yr\s:)-h{s:^j,,_,\xr) 



1=1 



1=1 

Af 



i=l 
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< >^nh {YiGlSic) - nh {SiG,M-l\X^G) 



1=1 



where step (a) follows from the definition of Y_j. ( [47] ), step (b) follows from Propositions [2] and [s] step (c) 
follows because {7r^^'^'^\i)}f£i = {1,2,--- ,M}, step (d) follows from Proposition [2j and finally step 
(e) follows from Lemma [l] We have shown that {X^(j}fi^ maximizes Y.Zi^i^T'^'^i'^ ^i) and clearly 
the maximum is given by n J2iLi li^iG'-, Y-ic, S_iQ), and hence we have the result. ■ 
Remark 8: The vector genie is a generalization of the ETW genie and hence Theorem l6] simplifies to 



the ETW bound ( 1 8 1 for the two-user interference channel. For the two-user interference channel, the 



ETW genie is also used to derive outer bounds (14 20 1 on the entire capacity region. In a similar fashion, 
the vector genie can also be used to derive outer bounds on the entire capacity region of an arbitrary 
Gaussian interference network. 

Similar to the two-user case, we proceed to tighten the outer bound by correlating the noise terms in 
the genie signals to the receiver noise. In particular, we explore if there exists a genie that is not just 
useful, but also smart, to establish the sum capacity in the low interference regime. 



C. Three user symmetric interference channel 

To simplify the presentation, we will restrict our attention to the symmetric three user channel, i.e., 
Pt = P, Vt and hrt = h^'ir ^ t. To make the genie smart, we let the noise terms in the genie signals be 
correlated to the noise at the receiver. 





r = 1 


r = 2 


r = 3 


Yr : 


Xi + hX2 + hXs + Zi 


X2 + hXi + hXs + Z2 


X3 + hXi + hX2 + Z3 


Sr,l '■ 


hXi + hX3 + hmWii 


hX2 + hXi + hr]iW2i 


hX-s + hX2 + h^Wsi 


Sr,2 '■ 


hXi + hri2W 12 


hX2 + hr]2W22 


/1X3 + hri2Wz2 



Here {W^fcl^f ^ ^^^^ are zero mean, unit variance, Gaussian random variables, and r/i, 772 are real variables. 
Let S denote the covariance matrix of the random vector [Zr Wri Wr2V (which is independent of r): 





1 


Pi 


P2 




E = 


Pi 


1 


Pl2 


(48) 




P2 


P12 


1 





Thus the genie is parameterized by {S, r/i, 772}- 
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Lemma 15 (Useful Genie): The genie is useful i.e., 

M 

Csum < IjXiG] YjG, S_iQ) 



i=l 



when 



Cov ([Zi hmWii]'^\Wi2) -Cov ([hrjiWu /ir/2VFi2]^) > 0. 
Proof: Following the proof of Theorem [6] we only need to show that 



(49) 



M 



M 



i=l i=l 

is maximized by {X?^}. For i = 1, 



(50) 



1^-22 



Using Lemmas [6] and [4j it follows that ( |50l ) is maximized by {^^^j if the condition ^49\ holds. ■ 
We next give the conditions for the genie to be smart in the following lemma, which is an extension of 
Lemma [T2I 

Lemma 16 (Smart Genie): The genie is smart, i.e.. 



iff the following conditions hold 



I{XiG;YiG,SiG)=I{XiG;YiG) 



T]ipi = 1 + 2h^P - hP 



(51) 



(52) 



Proof: Since 



T]2P2 = 1 + 2h^P. 
I{X,G;YiG,SiG) = I{XiG;YiG) + I{X,G;SiG\Y,G) 



pT\ is equivalent to 

I{XiG;SiG\YiG)=0. 
From Lemma [8} it follows that (53 1 is true iff 

I{XiG; S,,iG\YiG) = 
I{XiG; S^,2G\YiG) = 0. 



(53) 



(54) 
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Using Lemma [7] we have 

I{Xig;Si,ig\Yig) = 
^ I{Xig; XiG + X3G + ViWu\XiG + hX^G + hX^G + Zi) = 

^ E [{XsG + VlWll){hX2G + hXsG + ^l)] = E [{hX2G + hXsG + Zi)^] 

^ hP + r/ipi = 1 + 2/1^ P. 

and 

/(^ig;5i,2gI>1g) = 
^ /(Xig; XiG + V2Wi2\XiG + hX2G + hXsG + Zi) = 

^ E [mWi2{hX2G + hXsG + ^l)] = E [{hX2G + /i^3G + Z 



^2l 



??2/92 = 1 + 2h^P. 



Theorem 7: For the symmetric three user Gaussian interference channel, suppose there exist {Ti )p 
0, ??i,??2} satisfying (|49]l and (52), then treating interference as noise achieves the sum capacity, which 



is given by 

UnUke in the two-user case, we have not been able to provide an explicit equation for the threshold on h 
(as a function of P) below which treating interference as noise achieves the sum capacity. Nevertheless, for 
every P, admissible values of h can be found numerically by searching for the parameters {S ^ 0, ryi, r/2} 
that satisfy the conditions in Theorem [7] 

Using a scalar genie similar to that used for the two-user interference channel, Shang et. al. obtained 
a threshold on INRtotai that is independent of the number of users [23, Theorem 4]. In Figure |7] we 
plot a few admissible points that are computed numerically along with the INRtotai obtained using the 
scalar genie. An increase of more than 1 dB in the INRtotai threshold is seen by using the vector genie 
instead of the scalar genie. Note that INRtotai threshold obtained using the vector genie for the three-user 
interference channel is greater than the INR threshold for the two-user interference channel (which is 
same as the INRtotai threshold obtained using the scalar genie). 

Although, the thresholds we obtain in this paper are only lower bounds to the optimal threshold, we 
believe that the trend shown by the vector genie holds true, i.e., the optimal interference threshold, below 
which treating interference as noise achieves sum capacity, increases with the number of users. The 
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Fig. 7. Three user symmetric Gaussian interference channel: INRtotai threshold, below which treating interference as noise 
achieves the sum capacity, as a function of SNR. 



optimality of treating interference as noise in the low interference regime implies that the receivers are 
not able to exploit the structure in the interference. With more users in the network, the ability of the 
receiver to exploit the structure in each of the interfering user's signal can only decrease because the 
interfering users' signals interfere with each other. 

VIII. Conclusions 

We provided new, improved genie-aided outer bounds on the capacity region of a two-user Gaussian 
interference channel. Using these outer bounds, we showed that treating interference as noise achieves the 
sum capacity in a low interference regime. Similar results were established in parallel by Shang, Kramer 
and Chen [11], and Motahari and Khandani [12]. Although the interference threshold, below which 
treating interference as noise achieves sum capacity, is identical in the three works, the mathematical 
approach is considerably different. It is also to be noted that what has been obtained in all three works 
is only a lower bound on the interference threshold, and the question still remains as to what the optimal 
interference threshold is. 

A natural extension of the two-user results is the generalization of the optimality of treating interference 
as noise in the low interference regime to Gaussian interference networks with more than two users. 
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We provided closed form expressions that characterize the low interference regime for the many-to-one 
and one-to-many interference channels. Furthermore, we generalized the ETW genie [9] to an arbitrary 
Gaussian interference network, i.e., proposed a systematic construction of a genie such that treating 
interference as noise with Gaussian inputs achieve the sum capacity of the genie-aided network. We 
called this genie a vector genie, because it involves giving multiple side information signals to each 
receiver. Similar to [9], [21], this vector genie can be used to derive outer bounds on the entire capacity 
region. 

By correlating the noise terms in the vector genie, we showed that the outer bound can be further 
tightened to establish the sum capacity in a low interference regime. For reasons of computational 

complexity, we only considered a three user symmetric interference channel, for which we demonstrated 
that the total interference threshold can be higher than that for the two-user case. The interesting question 
that remains to be answered is: how does the optimal interference threshold scale as a function of the 
number of interferers in the network? 
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